Network based real-time analytics of raw video streams

ABSTRACT

A video stream is received over a network from a remotely located video capture device. The video stream is processed in real-time or near real time. The processing of the video stream extracts at least one metric from content of the video stream. The extracted metric is compared against at least one previously established value to generate either a TRUE or a FALSE result. Responsive to a TRUE result, at least one programmatic action is automatically initiated. The previously established value, the programmatic action, or both are user configurable. The programmatic action is a real time or a near real time action resulting from analyzing content of the video stream. Responsive to a FALSE comparison result, the at least one programmatic action is not automatically initiated.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation in part of U.S. patent applicationSer. No. 12/180,431, filed Jul. 25, 2008 (pending), which isincorporated herein in its entirety.

BACKGROUND

The present invention relates to the field of video analytics and, moreparticularly, to performing real-time analytics using a networkprocessing solution able to directly ingest internet protocol (IP)camera video streams.

Intelligent video surveillance (IVS) plays a pivotal role in managingthreats, maintaining safety, and assisting in security. IVS systemsprovide analytics, alert first responders during an incident event, andprovide a deterrent to potential aggressors. Many intelligent videosurveillance systems require intermediate systems such as videomanagement systems (VMSs) to organize surveillance artifacts (e.g.,cameras, locations, footage, etc). That is, a local VMS is effectively alocal hub, which peripheral devices (e.g., video cameras, microphones,surveillance sensors, etc.) connect. Local VMSs can process the receivedinput, can record timed video, and can perform other programmatic tasks.

A number of network solutions (IBM's Smart Surveillance Solution, forexample) exist which provide services to enhance capabilities ofexisting VMSs. These network solutions can integrate data from multiplesensors and analog and digital cameras into one searchable system, canpermit searching of data according to a broad range of parameters (e.g.,time, date, alert, object, size, location, and color), can share dataacross agencies, countries and departments, can permit information to beaccessed and viewed remotely from a Web browser, can prioritize criticalevents and store video associated with these events in long termstorage, and can analyze footage for perpetrator identification, theftprevention and damage detection, customer behavior, etc.

Conventional network solutions are designed to only interact with VMSs.Many potential customers, however, do not possess a VMS and/or woulddesire to minimize their video surveillance costs by retiring anexisting VMS, if an option existed to receive desired services directlyfrom a network solution provider. For example, many individuals and/orentities desire capabilities of video analytics, which is a capabilitygenerally lacking or non-robust in all but the highest end VMSs. Itwould be beneficial if network solutions providing video processingcapabilities, such as analytics, were made more accessible byeliminating the requirement, which often functions as an entry barrier,of possessing a VMS.

BRIEF SUMMARY

In one embodiment of the disclosure, a method, computer program productor system can receive a video stream over a network from a remotelylocated video capture device. The video stream is processed in real-timeor near real time. The processing of the video stream extracts at leastone metric from content of the video stream. The extracted metric iscompared against at least one previously established value to generateeither a TRUE or a FALSE result. Responsive to a TRUE result, at leastone programmatic action is automatically initiated. The previouslyestablished value, the programmatic action, or both are userconfigurable. The programmatic action is a real time or a near real timeaction resulting from analyzing content of the video stream. Responsiveto a FALSE comparison result, the at least one programmatic action isnot automatically initiated.

In one embodiment of the disclosure, a system can perform videoanalytics. The system can include at least a video surveillance system,a filter, and a software engine. The video surveillance system ingestsvideo streams from a remotely located video capture device. The videosurveillance system performs real-time or near-real time video analyticson the video stream. The filter is specific to the remotely locatedvideo capture device that is an application programming interface (API).The video surveillance system is unable to process the video streamreceived from the video capture device in absence of the applicationprogram interface. The software engine can include program instructionsstored in at least one non-transitory medium. The program instructionsare able to be executed by at least one processor to perform at leastone programmatic action

responsive to results produced by an analytics engine that performs thereal-time analytics. The at least one action is a notification actionthat conveys a notification to at least one previously designated userwhen a previously established condition is automatically detected by theanalytics engine.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

FIG. 1 is a schematic diagram illustrating a set of scenario fordirectly ingesting raw video streams from internet protocol (IP) camerasand performing real-time analytics on the received video streams inaccordance with an embodiment of the inventive arrangements disclosedherein.

FIG. 2 is a schematic diagram illustrating a system for providingreal-time analytics on directly ingested IP camera video streams inaccordance with an embodiment of the inventive arrangements disclosedherein.

FIG. 3 is a flowchart illustrating a method for executing real-timeanalytics on directly ingested internet protocol (IP) camera videostreams in accordance with an embodiment of the inventive arrangementsdisclosed herein.

DETAILED DESCRIPTION

Embodiments of the present invention disclose a solution for performingreal-time analytics using input from internet protocol (IP) camerasdirectly connected to a network, where the analytics are performed by aremotely located network element. In the solution, a network elementproviding intelligent video surveillance (IVS) services is able todirectly interact with raw output of a set of one or ore IP cameras. Novideo management system (VMS) intermediary is needed or is existentbetween the IP cameras and the remotely located IVS service provider.The IVS service provider can perform real-time analytics a video streamdirectly ingested from one or more IP cameras. Real-time analyticsperformed on the stream can include face recognition, object tracking,motion detection, and the like.

In one embodiment, an owner of an IP camera or an establishment wherethe IP cameras are deployed can establish user/location specific profilesettings. These profile settings can specify thresholds and elements tobe examined by analytic processing operations and can establish userspecific programmatic actions to be performed based the analyticprocessing results. Programmatic action can include, for example,notification, alerts, programmatic actions altering a localized system,and the like. Profile settings can be arbitrarily complex which caninclude multiple IP camera video streams, one or more analytics perstream, and the like.

Embodiments of the invention permit complex digital signal processing(DSP) and video based analytics to be performed in real time or nearreal time by network based computers. For example, these analytics canbe performed as a Web service or other software service. Thus, insteadof requiring end-users to host and purchase expensive video analyticshardware and software, raw video captured at a customer location can beanalyzed. This analysis can occur rapidly, which permits real-timeresponses on location.

For example, a video capture device located in a store can capture avideo of a theft, which is undetected by in-store personnel. This videocan be streamed over a network, where metrics are extracted duringprocessing. These metrics can be compared against established values todetermine that a consumer is attempting to shoplift an item by hiding itin his/her closing without payment. Appreciably, such detailed analyticscan require substantial computing processing power and logic, which isbeyond the ability of all but the highest end security systems availabletoday. Once the shoplifting attempt is determined, a TRUE comparisonresult can be generated, which triggers a programmatic action toimmediately inform the store of the ongoing theft. When a FALSEcomparison result (no shoplifting or other adverse event detected byvideo analysis), no action or message is sent. The store owners can beinformed through a message, notification, call, or other electronicmeans. Thus, the programmatic action can be as simple as sending amessage. The message may include a portion of the video showing thetheft and/or an analysis of what occurred, which provides proof to theresponder of the incident.

In another example, a street level camera can capture video of anaccident. This raw video can be streamed over the network forprocessing. The processing can automatically indicate an incident hasoccurred, which evaluates as a TRUE comparison result. The programmaticaction triggered can be to provide the accident video to a device of aresponding officer, who can utilize this information for his/her report.In another embodiment, a report can be partially generated/completedautomatically based on video analytics, which can save a respondingofficer a considerable amount of time. Additionally, programmaticactions can immediate contact responders, such as an ambulance service,to ensure that help arrives on a scene as rapidly as possible. Similaranalytic actions can detect a fire in progress (evaluated as a TRUEcondition), which triggers a programmatic action of informing firedepartment responders.

As will be appreciated by one skilled in the art, aspects of the presentinvention may be embodied as a system, method or computer programproduct. Accordingly, aspects of the present invention may take the formof an entirely hardware embodiment, an entirely software embodiment(including firmware, resident software, micro-code, etc.) or anembodiment combining software and hardware aspects that may allgenerally be referred to herein as a “circuit,” “module” or “system.”Furthermore, aspects of the present invention may take the form of acomputer program product embodied in one or more computer readablemedium(s) having computer readable program code embodied thereon.

Any combination of one or more computer readable medium(s) may beutilized. The computer readable medium may be a computer readable signalmedium or a computer readable storage medium. A computer readablestorage medium may be, for example, but not limited to, an electronic,magnetic, optical, electromagnetic, infrared, or semiconductor system,apparatus, or device, or any suitable combination of the foregoing. Morespecific examples (a non-exhaustive list) of the computer readablestorage medium would include the following: an electrical connectionhaving one or more wires, a portable computer diskette, a hard disk, arandom access memory (RAM), a read-only memory (ROM), an erasableprogrammable read-only memory (EPROM or Flash memory), an optical fiber,a portable compact disc read-only memory (CD-ROM), an optical storagedevice, a magnetic storage device, or any suitable combination of theforegoing. In the context of this document, a computer readable storagemedium may be any tangible medium that can contain, or store a programfor use by or in connection with an instruction handling system,apparatus, or device.

A computer readable signal medium may include a propagated data signalwith computer readable program code embodied therein, for example, inbaseband or as part of a carrier wave. Such a propagated signal may takeany of a variety of forms, including, but not limited to,electro-magnetic, optical, or any suitable combination thereof. Acomputer readable signal medium may be any computer readable medium thatis not a computer readable storage medium and that can communicate,propagate, or transport a program for use by or in connection with aninstruction handling system, apparatus, or device.

Program code embodied on a computer readable medium may be transmittedusing any appropriate medium, including but not limited to wireless,wireline, optical fiber cable, RF, etc., or any suitable combination ofthe foregoing. Computer program code for carrying out operations foraspects of the present invention may be written in any combination ofone or more programming languages, including an object orientedprogramming language such as Java, Smalltalk, C++ or the like andconventional procedural programming languages, such as the “C”programming language or similar programming languages. The program codemay execute entirely on the user's computer, partly on the user'scomputer, as a stand-alone software package, partly on the user'scomputer and partly on a remote computer or entirely on the remotecomputer or server. In the latter scenario, the remote computer may beconnected to the user's computer through any type of network, includinga local area network (LAN) or a wide area network (WAN), or theconnection may be made to an external computer (for example, through theInternet using an Internet Service Provider).

Aspects of the present invention are described below with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems) and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer program instructions.

These computer program instructions may be provided to a processor of ageneral purpose computer, special purpose computer, or otherprogrammable data processing apparatus to produce a machine, such thatthe instructions, which execute via the processor of the computer orother programmable data processing apparatus, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks.

These computer program instructions may also be stored in a computerreadable medium that can direct a computer, other programmable dataprocessing apparatus, or other devices to function in a particularmanner, such that the instructions stored in the computer readablemedium produce an article of manufacture including instructions whichimplement the function/act specified in the flowchart and/or blockdiagram block or blocks.

The computer program instructions may also be loaded onto a computer,other programmable data processing apparatus, or other devices to causea series of operational steps to be performed on the computer, otherprogrammable apparatus or other devices to produce a computerimplemented process such that the instructions which execute on thecomputer or other programmable apparatus provide processes forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks.

FIG. 1 is a schematic diagram illustrating a set of scenario 105, 160for directly ingesting raw video streams from internet protocol (IP)cameras and performing real-time analytics on the received video streamsin accordance with an embodiment of the inventive arrangements disclosedherein. In scenario 105, warehouse 114 owner 142 can utilize asurveillance service to monitor property 110. Service provided bycomputing environment 130 can include IP cameras 112 directly connectedto an intelligent video surveillance (IVS) system 132. Ingested video116 can be used to surveil property 110 using real-time analytics. Whenincident events occur, alert 150 can be conveyed to owner 142 via mobilecomputing device 140. Scenario 160 can represent a contemplatedembodiment of scenario 105 unlike prior art where IP cameras 112 areconnected indirectly to an IVS system 130 via a video management system.In one embodiment, standard communication protocols can be utilized forcommunicating between the IP camera 112 and the IVS system 132 andbetween the IVS system 132 and the mobile computing device 140.

In scenario 105, IP cameras 112 can be connected to intelligent videosurveillance system 132 via communication port 118. Communication port118 can include physical connections such as Ethernet, twisted pair,wireless communication ports, and the like. Physical layer componentsand network technologies can vary based on camera 112, port 118 andnetwork 120 configurations. Raw video stream 116 can be conveyed fromproperty 110 via network 120 directly to IVS system 132 without beingtreated by a video management system.

Engine 134 can receive and decode raw video stream 116 prior toperforming analytics on stream 116. Default analytics established bycomputing environment 130 and IVS system 132 can be combined with owner142 settings to provide customized monitoring for property 110. Forinstance, to reduce the likelihood of false alerts from facialrecognition, owner 142 can provide portrait pictures of authorizedpersonnel for property 110. Analytics engine 134 can be used to detectincident events which can include, motion detection, object tracking,presence detection, and the like.

Mobile computing device 140 can be a portable hardware/software deviceable to receive alerts 150 and communicate with computing environment130. Device 140 can include mobile phone, personal digital assistant(PDA), laptop, ultra-mobile computing devices, and the like. The device140 need not be a portable device, but can be any device (e.g., apersonal computer, a home telephone, etc.) able to receive communicatednotifications.

Computing environment 130 can include a set of software components ableto provide monitoring and analysis functionality. For example,environment 130 can be a JAVA 2 ENTERPRISE EDITION (J2EE) environment130, such as IBM's WEBSPHERE. Functionality can be embodied as Webservices which can include remote control, monitoring, reporting, andthe like. Components can include intelligent video surveillance system132 and analytics engine 134. In one embodiment, IVS system 132 can beimplemented within a middleware software platform.

In scenario 160, an IP camera 180 can convey a raw video stream to asmart surveillance engine (SSE) 184. SSE 184 utilizing DIRECT SHOWfilter 182 can process the raw video stream received from IP camera 180.DIRECTSHOW filter 182 can be a software application programminginterface (API) able to decode Motion Picture Experts Group (MPEG),Motion Joint Photographic Expert Group (M-JPEG), and the like. Decodedvideo streams can be analyzed in real-time by SSE 184 to providenotifications and alerts to appropriate entities. Middleware for LargeScale Surveillance (MILS) server 168 can provide consolidation,management, and access for video streams processed by SSE 184. In oneembodiment, MILS server 168 can be a JAVA 2 ENTERPRISE EDITION (J2EE)software platform. Metadata exported from video streams can be indexingand managed using database 118.

FIG. 2 is a schematic diagram illustrating a system 200 for providingreal-time analytics on directly ingested IP camera video streams inaccordance with an embodiment of the inventive arrangements disclosedherein. In system 200, intelligent video surveillance system 240 canprovide real-time analysis of video stream 216 provided by directlyconnected IP camera 210. System 240 determining an incident event (e.g.,unattended object) can respond by notifying/alerting associatedentities, altering the state of cameras 210 and/or surveillance system210.

As used herein, IP cameras 210 can include cameras able to convey avideo stream to an IVS system using one or more internet protocols. TheIVS system 240 can be one or more component systems lacking anintermediate video management system. System 240 can be able to record,monitor, perform real-time analytics, and reporting on IP camera 210streams. Real-time analytics can encompass real-time and near real-timeanalysis of video streams.

IP camera 210, which can include volatile memory 212 and transceiver214, can convey raw video stream 216 to IVS 240. Video informationreceived from camera 210 optics can be temporarily stored in volatilememory 212 prior to transmission. Transmission of video stream 216 toIVS 240 can be facilitated by transceiver 214 which can convey stream216 via network 220. In one embodiment, raw video stream 216 can includean H.264 MPEG4 encoded video stream.

IVS 240 can receive and process raw video stream 116 to condition thestream for analytics. Processing can be predicated on camera modules 248which can allow IVS 240 to interface with vendor specific cameraconfigurations. In one embodiment, modules 248 can be a plug-in basedframework allowing vendor specific application programming interfaces(APIs) to interoperate with IVS 240. Modules 248 can enable IVS 240 toperform actions such as query camera data, enable remote control ofcameras, and the like.

Once processed, video stream 216 can be analyzed and incident events canbe identified. Analytics engine 246 can perform one or more examinationsof video stream 216. In one embodiment, one or more frames of videostream 216 can be analyzed based on one or more specialized algorithms.Algorithms can include, but is not limited to, face recognition, pathtracking, object tracking, motion detection, presence detection, and thelike. Extracted data from video stream 216 can be stored in data store264. Data can include, but is not limited to, attribute data 266,incident information, actions taken in response to incident events, andthe like. For instance, attribute table 266 data can be used to indexand search processed video streams quickly.

Profile manager 242 can permit user and/or camera specific settings tobe maintained for a set of IP cameras 210. For instance, analytics suchas object tracking and license plate identification can be enabled forcameras surveilling a loading dock at a warehouse. Manager 242 can beutilized to maintain user notification settings which can vary based oncamera, analytics, incident events, and the like.

Notification engine 244 can be used to provide alerts to users,authorities, first responders, and the like. When an incident eventoccurs, notification engine 244 can communicate messages to one or moreuser configured devices. Further, engine 244 can be used to managevarying degrees of critical alerts. For instance, when motion isdetected in a non-critical area of surveillance, a text exchange messagecan be delivered to a user notifying of a possible presence.

Communication server 242 can enable IVS 240 to execute one or morecommunication functions in response to real-time analytics performed.Server 242 can include, but is not limited to, a text exchange server,telephony server, facsimile server, and the like. Although presented asa separate entity communication server 242 functionality can beexpressed in IVS system 240.

FIG. 3 is a flowchart illustrating a method 300 for executing real-timeanalytics on directly ingested internet protocol (IP) camera videostreams in accordance with an embodiment of the inventive arrangementsdisclosed herein. Method 300 can be performed in the context of system200. In method 300, one or more IP cameras can convey video streamsdirectly to an intelligent video surveillance (IVS) system which caninitiate real-time analytics on the video streams.

As used herein, IP cameras can include cameras able to convey a videostream to an IVS system using one or more internet protocols. The IVSsystem can be one or more component systems lacking an intermediatevideo management system able to record, monitor, perform real-timeanalytics, and reporting. Real-time analytics can encompass real-timeand near real-time analysis of video streams. The analytics, which neednot occur in real time, can also be performed after an arbitrary delay.

In step 302, one or more IP cameras can establish a direct connection toan IVS system. In step 305, the IVS system can identify a raw videostream originating from an IP camera. In step 310, the raw video streamfrom the IP camera can be received. In step 315, the raw video streamcan be decoded and processed. In step 320, real-time analytics can beperformed on the video stream based on one or more processing criteriaand/or user profile settings. Criteria/settings can include, facerecognition, path tracking, object tracking, motion detection, and thelike. In step 325, if analytics identifies an incident event hasoccurred, the method can proceed to step 330, else return to step 310.In step 330, a programmatic action can be performed by the IVS system.Actions can include notification and/or alerting appropriate entities,altering a localized system state (e.g., zooming/panning a camera),adjusting analytics, and the like. In step 335, the IVS system canoptionally log the incident event in a system log, user history log, andthe like.

The flowchart and block diagrams in the FIGS. 1-3 illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof code, which comprises one or more executable instructions forimplementing the specified logical function(s). It should also be notedthat, in some alternative implementations, the functions noted in theblock may occur out of the order noted in the figures. For example, twoblocks shown in succession may, in fact, be processed substantiallyconcurrently, or the blocks may sometimes be processed in the reverseorder, depending upon the functionality involved. It will also be notedthat each block of the block diagrams and/or flowchart illustration, andcombinations of blocks in the block diagrams and/or flowchartillustration, can be implemented by special purpose hardware-basedsystems that perform the specified functions or acts, or combinations ofspecial purpose hardware and computer instructions.

The terminology used herein is for the purpose of describing particularembodiments only and is not intended to be limiting of the invention. Asused herein, the singular forms “a,” “an,” and “the” are intended toinclude the plural forms as well, unless the context clearly indicatesotherwise. It will be further understood that the terms “comprises”and/or “comprising,” when used in this specification, specify thepresence of stated features, integers, steps, operations, elements,and/or components, but do not preclude the presence or addition of oneor more other features, integers, steps, operations, elements,components, and/or groups thereof.

The corresponding structures, materials, acts, and equivalents of allmeans or step plus function elements in the claims below are intended toinclude any structure, material, or act for performing the function incombination with other claimed elements as specifically claimed. Thedescription of the present invention has been presented for purposes ofillustration and description, but is not intended to be exhaustive orlimited to the invention in the form disclosed. Many modifications andvariations will be apparent to those of ordinary skill in the artwithout departing from the scope and spirit of the invention. Theembodiment was chosen and described in order to best explain theprinciples of the invention and the practical application, and to enableothers of ordinary skill in the art to understand the invention forvarious embodiments with various modifications as are suited to theparticular use contemplated.

What is claimed is:
 1. A method comprising: one or more computersreceiving a video stream over a network from a remotely located videocapture device; at least one of the one or more computers processing thevideo stream in real-time or near real time, wherein the processing ofthe video stream extracts at least one metric from content of the videostream; at least one of the one or more computers comparing theextracted metric against at least one previously established value togenerate either a TRUE or a FALSE result; responsive to a TRUE result,at least one of the one or more computers automatically initiating atleast one programmatic action, wherein the previously established value,the programmatic action, or both are user configurable, and wherein theprogrammatic action is a real time or a near real time action resultingfrom analyzing content of the video stream; and responsive to a FALSEcomparison result, the one or more computers not initiating the at leastone programmatic action.
 2. The method of claim 1, wherein the videostream captures input from a geospatial region, wherein an authorizedentity is able to configure the established value, the programmaticaction, or both is has responsibility and authority over the geospatialregion.
 3. The method of claim 1, wherein the video capture device is anetwork connected IP camera.
 4. The method of claim 1, wherein thereceived video stream is raw, unprocessed video captured by a videocapture device.
 5. The method of claim 1, further comprising: at leastone of the one or more computers determining a processing filter for thevideo capture device from a plurality of different processing filters,each of the different processing filters being mapped to different videocapture devices or to different types of video capture devices, whereinthe processing uses the determined processing filter.
 6. The method ofclaim 1, wherein said programmatic action is at least one of anotification, an alert, and an action altering the state of a localizedentity.
 7. The method of claim 1, wherein the processing of the videostream and the comparing of the extracted metric are performed as partof an object tracking analysis of the video stream performed by the oneor more computers.
 8. The method of claim 1, wherein the processing ofthe video stream and the comparing of the extracted metric are performedas part of a face recognition analysis of the video stream performed bythe one or more computers.
 9. The method of claim 1, wherein theprocessing of the video stream and the comparing of the extracted metricare performed as part of a motion detection analysis of the video streamperformed by the one or more computers.
 10. The method of claim 1,wherein the one or more computers are part of a middleware implementedsolution for processing received video streams.
 11. The method of claim1, wherein the received video stream is a raw, real-time video streamfrom a network connected IP camera, which is the remotely located videocapture device.
 12. The method of claim 1, further comprising: the oneor more computers processing the video stream using an applicationprogram interface (API), wherein the processing comprises decoding thevideo stream from the network connected IP camera, and wherein theapplication program interface is a filter specific to the internetprotocol camera, wherein different types, versions, and varieties of IPcameras are associated with different filters or APIs.
 13. The method ofclaim 1, wherein the processing occurs using an analytics enginecomprising program instructions stored in a memory that execute on onemore processors of the one or more computers, wherein the video streamis received and processed using an application program interface (API),wherein the analytics engine is a component of an intelligent videosurveillance system that is unable to process the video stream inabsence of the application program interface.
 14. The method of claim 1,wherein the comparing is performed as part of one of more of: a facerecognition process, an object tracking process, and a motion detectionprocess.
 15. The method of claim 1, wherein the initiated programmaticaction conveys an alert state, an alert, or a notification to an entityowning or controlling the geographic region from which the video streamwas captured.
 16. The method of claim 1, wherein the processing of thevideo stream comprises: exporting metadata from the video stream; andindexing the metadata within a database system.
 17. A computer programproduct comprising: a computer usable storage medium storing computerusable program code; computer usable program code being executable by atleast one processor to receive a video stream over a network from aremotely located video capture device; computer usable program codebeing executable by at least one processor to process the video streamin real-time or near real time, wherein the processing of the videostream extracts at least one metric from content of the video stream;computer usable program code being executable by at least one processorto compare the extracted metric against at least one previouslyestablished value to generate either a TRUE or a FALSE result; computerusable program code being executable by at least one processor to,responsive to a TRUE result, automatically initiate at least oneprogrammatic action, wherein the previously established value, theprogrammatic action, or both are user configurable, and wherein theprogrammatic action is a real time or a near real time action resultingfrom analyzing content of the video stream; and computer usable programcode being executable by at least one processor to, responsive to aFALSE comparison result, not initiate the at least one programmaticaction.
 18. The computer program product of claim 17, wherein the videostream captures input from a geospatial region, wherein an authorizedentity is able to configure the established value, the programmaticaction, or both is has responsibility and authority over the geospatialregion.
 19. The computer program product of claim 18, furthercomprising: computer usable program code being executable by at leastone processor to, determine a processing filter for the video capturedevice from a plurality of different processing filters, each of thedifferent processing filters being mapped to different video capturedevices or to different types of video capture devices, wherein theprocessing uses the determined processing filter.
 20. A system forperforming video analytics comprising: a video surveillance system,comprising one or more processors for ingesting video streams from aremotely located video capture device, wherein said video surveillancesystem performs real-time or near-real time video analytics on the videostream; a filter specific to the remotely located video capture devicethat is an application programming interface (API), wherein the videosurveillance system is unable to process the video stream received fromthe video capture device in absence of the application programinterface; and a software engine, comprising program instructions storedin at least one non-transitory medium, said program instructions able tobe executed by at least one processor to perform at least oneprogrammatic action responsive to results produced by an analyticsengine that performs the real-time analytics, wherein at least oneaction that the software engine is configured to automatically performis a notification action that conveys a notification to at least onepreviously designated user when a previously established condition isautomatically detected by the analytics engine.